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AESTRACr 

A promising measure of learning ability has emerged 
from extensive research on schema theory: the Schematic Concept 
Formation (SCF) Test. Experimental evidence has already demonstrated 
substantial individual differences in SCF performance for third and 
fourth graders and college students. Because SCF depends on the 
learning of relatively unfamiliar patterns rather than upon 
measurement of previous learning ^ it might be utilized to tap a few 
of the more important cognitive abilities in ways not presently 
available. A measure of SCF ability which could be shown to be 
substantially unrelated to cultural background or educational level, 
and which had some power to predict learning ability^ would be 
socially relevant and extremely useful in both educational and 
industrial settings. In order to assess the potential utility in this 
context, two studies were conducted, a pilot study and a main study. 
The purpose of the pilot study was primarily to refine the SCF tefst 
for subsequent use; the purpose of the main study was co determine 
the predictive power of the test in a remedial training program. The 
results indicate that SCF test does have some potential utility as a 
measure of cognitive aptitude in disadvantaged students, where such 
aptitudes are defined as aptitudes bearing on success in a remedial 
training program. (Author/JM) 
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Purpose of this project ve.s the de\^elopinsnt and preliitiinary testing 
of a process^riented measure of cognitive aptitude as an efficient and 
economical predictor of disadvantaged students* college potential. A 
Schematic Concert Formation (9CF) Task, utilizing corputer generated 
graph-like and language-like patterns/ xvas designed/ refined , and admin- 
istered to the nin-ety-eight students in the Developiiental Studies Program 
at McLennan Cantmnity College, ^^feco, Texas / at the beginning of their 
year of ronedial study. At the end of the school year/ students' SCF 
results v;ere correlated with teachers* ratings of learning ability and 
academic irtproveinent and with the students' academic performance. The 
demonstrated individual differences in SCF ability of disadvantaged 
students were shown to have sane utility in predicting both teachers' 
ratings and academic performance. 
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I. INTRDDUCriaSJ 



Many yuung pecple — both sec^cmdary school graduates and drop-outs 
— axe potential candidates for college edxocation, ijut becaiase of disad- 
vantaged background (that is, they are acadsinically, socio-^corariicallyr 
or culturally deprived) they cannot succeed in the acadsnic envirarme^nt 
mthout special help. The problem is to identify these people and 
encourage thCTi to re-enter ed\x:ational programs r and to inaka the most 
effective use of the limited facilities available for d9Vslop:nental or 
renedial training. 

Sane disadvantaged youngsters, like many boys and girls frcro all 
^ralks of life, are not likely to benefit frora college education. .An 
indicaticai of this probability v?otild facilitate counseling and voca-- 
tioBial planning for this groi?) and wuld perhaps avoid an additional 
damaging experience of failure for the young person. 

Conventional tests are not suitable for discovering sclr^lastic 
promise in the disadvantaged. Largely designed for middle and upper 
class Caucasians/ these tests require verbal and numerical skills unlike 
the skills possessed by students of other backgrounds • These tests 
sartple \A]at has been learned instead of meastiring learning ability 
itself. Such tests / v^ch measure the students* v^aknesses and gauge 
deficiencies in subject matter are useful for estimating immediate 
academic performance. They wxild ireflect learning ability only if all 
students had been ej^sed to equal training or e><perience — obviously not 
the case vdth the culturally disadvantaged • Our conoem is to saitple 
the learning p2X)cess itore directly and to ascertain the extent to vfeLch 
the student can profit by rCTiedial training. 

Achievement in elementary and secondary school may also be an 
inappropriate indicator of learning potential. Acadonic achievement is 
affected by motivational and personality factors influenced by poverty^ 
substandard schooling/ discrimination/ or other conditions of depriva- 
tion. 

At the present time/ individual interviews are often losed for the 
assessment of applicants for ^^ai^ial develojxnental programs. VJhile 
this method may be the best tool available/ it is highly dependent on 
the skill of the interviewer and/ at best/ is tima consuming and expensive. 

A premising measure of learning ability has anerged f rem extensive 
research on schema theory (Oldfield/ 1954; Attneave^ 1957; Evans / 1964; 
EvanS/ 1967a) : the Schematic Concept Formation (SCF) Task. Vfe proposed 
to investigate this measure as a predictor of post-secondary academic 
achievement of disadvantaged students. 



SCB' is a'v?ell derronstrated pbsiicffnenon (Edmonds & Evans ^ 1956; 
Bdrtonds, Evans, & Mieller, 1966rEdiTor>ds & Mueller,. 1967; Evans & 
P^rvaoltr 1967; EanJcin & Evans,. 1968; Berstad, Broim, & Evans,. 1959; 
Bcown Sc Evans, 1959; Jones & Hblley, 1970; Rankin^ IVlarkley & Evans, 
1970) . It gxr&r out of schema theory, ^viiich is a frame o£ reference for 
strudying tte processes involved in pattern learning and pattern percep- 
tion- Schsroa theory sxjpposes that hurrans are able to select the essen- 
tial or iiTportant features — the scheina — wnich characterize categories 
of objects in an orderly environment* 

It has been suggested (Wbodworth,. 1938; Oldfield, 1954; Attneave, 
1957) that people sinplify the recognition of objects by reiiieiribering 
these scb,fiinata; then new instances are sinply encoded as "schema pliis 
correction." The schsta v^ould be stored in mearory just or^e anu each 
nev^ instance v?ould be stored by noting only those aspects vvhich devi- 
ated from the schema, reducing infonration processing and storage 
reguir orients. 

Evans (1967a) extended this idea by pointing out that in an environ- 
nent containing a mixture of different schanata, people vgoiild have to 
learn to associate obj^rts vdth their corresponding schana. To account 
for this learning he postulated the process of schematic concept fonta- 
tion, defined as "the developtrent of the ability to assign objects to 
their correspording scheita families on the basis of the information 
derived fran perceiving the objects without any other source of informa- 
tion as to the appropriate categorization and without prior familiari- 
zation with the relevant schero. " A schena family is a population of 
objects, all of v*iich can be efficiently described by the same schema 
rule. Subjects can learn to jreoognize categories of things they have 
never seen before siirply by inspecting several instances of the schema 
family. Uiey can extract from the environment alone all the information 
needed to form categories and raneniber them. No feedback (knowledge of 
results or reinforcement) is necessary (Evans / 1964). Bctended schema 
theory thus bears not merely on how people remarber patterns, but also 
on concept formation and concept utilization. 

Experin^tal evidence has already demonstrated substantial indi- 
vidual differences in SCF performance for 3rd and 4th graders (Williams 
and Aiken, 1972), adolescents (Shields, Gordon, & Evans, 1969), and 
college stiadents (Bersted, Brown, & Evans, 1969). There is evidence 
that SCF relates to scholastic aptitude in high school students (Shields 
Gordon, & Evans, 1969) and we ^ave preliminary evidence of such a 
relationship in college studejits* 

Beca-jse SCF depends on the learning of relatively unfamiliar pat- 
terns rather than upon mscisureiTent of previous learning, we felt that 
it mi^t be utilized to tap a few of the more iirportant cognitive 



abUities in not presently available. A measure of SCF ability 
v.ihicK CJould be shewn to be si^bstantially unrelated to cultural background 
or educational level and v^iidx had sarrje power to predict learning ability 
would be socially relevant and exttremely useful in both educational and 
industrial settings. 

In order to assess the potential utility of the SCF test in this con- 
texty tWD studies \/^re conducted^ a pilot study and a main stuc3y. The 
purpose of the pilot study v?as primarily to refine the SCF test for subse- 
quent use, the purpose of the main study v?as to determine the predictive 
power of the test in a renedial training program., 

n. PHiOfr study 

A. Method 

Subjects, Subjects for the study vvere students enrolled in the 
Develcptental Studies Program CDSP) at I^cLennan Conmmity College, Vfeco^ 
Texas • This program, initiated in September, 1970, offers one year of 
intensive remedial training to students viix) could not otherwise master 
college wxrk. 

All inconing McLennan students are required to take the American 
College Testl and all vAiose ccnposite score is less than 12 must enroll 
in the DSP. Upon completion of 30 semester hours in this program, 
students enroll in regular courses for their final year at McLennan. 
Most of the school's 2,500 regular stixients go on to corrplete a four-year 
degree; the DSP group is encouraged to do the same. 

The 1970-71 DSP class members (N=38) were siabjects for the pilot 
study • The SCF test was administered to these students in October, 1970, 
about six weeks after they had entered the program. 

2. The SCF Test. A form of the SCF Test was assembled using two 
types of catputer generated VAPGUS (Variable Generator for UnfamiLiar 
Stimuli) patterns (Evans, 1967b; Evans and Mueller, 1966) v*dch have the 
following characteristics: 

a. They are randan saitples from defined populations of patterns. 
Thus, properly analyzed experimental results can be generalized both to 
the population of subjects a^d to the population of patterns. Attneave 
and Amoult (1956) discussed the importance of such a methodology. 



•^lie American College Testing Examination, Science Research Associ- 
ates, Inc., Chicago, Illijnois* 



b. They allow independent control of quantitative stirmliis 
parameters such as information content (cliannel capacity) and constraint 
redundancy (the extent to vvhich patterns conform to their schejna) . For 
further discussion of these parameters, see 13vans (1967c) . 

c. UhB task is largely nonverbal in nature and should be rela- 
tively free froa the effects of training in verbal skills. 

d. Ihe patterns are relatively xmfairiliar to subjects, and 
perfonnance is dependent on \rtiiat subjects can learn on the task itself. 
Thus perfonnaance measures on the task assesses a learning process rather 
than the result of previous learning (Shields, Gordon/ & Evans, 1969) . 

e. Unlike most cognitive learning tasks, the learning in SCF 
is based on intrinsic information provided by the task itself rather 
than on evaluative feedback or knowledge of results. Consequently, 
the task is suitable for group administraticsi as a pencil and paper 
test* 

f . *Ihe patterns, v^ch are initially generated in the form of 
nxiribers/ can be represented in a number of different forms, so that 
different cognitive skills can be tapped. Ixi the present stvdy, ti\e 
patterns \^re represented both as graph-like figures (serriforms) and 
as sequences of syllables (Hollier and Ev<xris, 1967) resembling phrases 
in an lanfamiliar language (linguaforms) . 

The Vargus 9 coiputerized pattern generation methjod used in 
producing serriforms for tasks 1, 2, and 3 of the SCF task samples 
stimuli frcm a defined stimulus population in such a vay that each may 
be regcurfed as a set of independent and measurable deviations from a 
prototype (Evans and Mueller, 1966) . 

The Vargus 7 program (Evans, 1967b) generates segments of a 
Markov process to produce patterns. These patterns, translated into 
linguaforms, wre used in tasks 4, 5, and 6 of ttie SCF task. 

In tasks 1 and 4, subjects were asked to rate the siitdlarity 
of two patterns, and to judge vdiether they vere from the same schema 
families- In tasks 2 and 5, they were required to learn to identify 
exaitples of a single schema family in the context of patterns from many 
unrelatiisd schema families. The 3rd and 6th tasks required memory for 
the previoasly learned schema family — the subjects differentiated 
exaiTples of it fircm those of one other specific family. Ihe original 
form of the SCF Task contained 40 itanns per task for a total of 240 items. 



3 . feasures of Success in tha Egnedial Traixiing Program^ The 
ultdinate criterion of success in tlis program v.ould be the students' 
success in subsequent college ^\orlc. !rhat infoination, however, tends 
to be confounded, by drop-outs, differential college experiences, and 
thje liKe. For the nain purpose of the pilot study, therefore, success 
v;as defined more narrowly as judged success in the program itself. 
Thje judgments i\;ere provided by the Chairman of the Departinent, vSio 
ranked the stuients on tlie basis of his own experience ^vith theia as 
their teacher in the "Personal Groc^rth and Develofment" catxrse, and 
on the basis of consultation with the teaching staff. He provided 
two rankings: 

a. Capacity : his jijdginent of tlie student's rank in the class 
vdth respect to intellectual capacity or potential, regardless of the 
student's perf ordnance in the program; and - 

b. litprovenent : his assessttiant of the student's rank in the 
class with respect to the iirpcovennent in the student's scholastic skills 
during the program, regardless of the student's estimated intellectual 
capacity. 

The rankings v?ere itade after the school year had been ooirpleted; 
the departitent chairman had no knowledge of the student's SCF score when 
he made the rankings. 

B. Results 

To provide a preliminary assessment of the relationship of SCF per- 
formance to the variables of interest, separate scatter plots were made 
relating the six subtests to rated Capacity and to rated In^provement , 
Total SCF score for each staxient was also plotted against his averaged 
ratings. These plots were xised to permit a visual check against the 
possibility of nonlinear correlations and to identi:^ the most promising 
tiasks on the SCF ta^. The plots indicated linear relationships and 
showed no sign of important non-linearities . 

An item analysis was condiacted on the SCF data to identify \insat- 
isfactory items. This analysis yielded, among other things, the point 
biserial correlation between each iten and the total score on the sub- 
test \*dch included the item. Items vdiich had veary lew negative corre- 
lations with the subtest were deeroed imsatisf actory because they were 
evidently not measuring the same attribute measured by most of the items 
on the subtest* 

The same item analysis was also perforrred for subtests, 1, 2, 4, 
and 5 on data fron 375 college students at Cleveland State UirLversity* 



-isons of this analysis v/ith the analysis of the pilot stiady data 
,.xcated siibstantial consistency between the two WT.th respect to selection 
of unsatisfactory items. Three oi. four items on each subtask \^?ere clearly 
identified as unsatisfactory in both analyses. These i^rere dropped from 
the test, along with a few other relatively poor items so as to reduce each 
subtest to 35 items. The same procediire was applied to subtests 3 and 6, 
except that no confirming analysis from the Cleveland State data ^^^/as 
available. 

The instructions and answer sheets were also slightly rrvodif ied on the 
basis of the pilot study to facilitate administration and scoring. 

Quantitative analyses of the relationship between SCF performance and 
the judgments of success in the training program were also made. Becaiase 
of the relatively small number of Ss CN=38) , these analyses were regarded 
as only exploratory. Preliminary examination of the data indicated that 
there was a moderate correlation between the two rankings, capacity and 
iirprovCTent. In view of this observation and of the expectation that these 
rankings probably contained a substantial amomt of unpredictable variance, 
the decision was xoade to add the two rankings together so as to obtain a 
single score for each subject — hopefully a score representing a larger 
proportion of reliable variance. 

A step-wise linear regression v;as carried out with the combined ranking 
as the criterion and the scores on the six siabtests as predictors. Three 
additional predictors were also included: the unweighted sum of the scores 
on the first three subtests, the unweighted sum of the scores on the last 
three subtests, and the unweighted sum of the scores on all the tests. 
It was recognized, of course/ that these sums were linearly dependent upon 
the subtest scores, so that they represented no predictive variance not already 
in the subtest scores. They were -used, however/ for two reasons: First, an 
unweighted sum is a sirrpler alternative to the weighted sum v^ch is irtpljLed 
by a multiple regression; thus the inclusion of -unweighted sums \>70uld allow 
a direct assessttent of how^ much predictive power was being gained by treating 
the six subtests separately as contrasted with forming one or two sumnary scores 
Second/ a sum is more reliable than its ooirponents taken separately, anxl reli- 
ability was deemed of possibly greater iitportance here than the optimal weight- 
ing offered by linear regression. 

A stepHwise regression method makes it possible to include linearly 
dependent items in the set of predictors because it does not attenpt to can- 
pute a regression equation using all the predictors at once. Instead, it 
chooses the single variable vMch affords the best prediction by itself and 
forms a predictive equation based on that variable. It than chooses from 
the renHining variables the one vMch woxild most iitprove the predictive 
power of the equation, and cotputes a new equation based on these two chosen 
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variables. In similar stepwise fashion, it continues to add new variables 
to the equation until a criterion is reached indicating that no further 
iirprovement in predictive power is possible » 

At each step, the regression program prints out the equation, multiple 
regression coefficient, and other information \^ch can be \ised to assess the 
results. This stepwise method thus allows the user to choose the step at 
which the results best suit his purpose and so to select a few of the best 
predictois out of the set originally considered. ^\!hen sets of items are 
highly intercorrelated or linearly dependent, some of them are sintply left 
out of the equation. 

The step/ise regression analysis revealed that the grand sum of all 
svibtests was indeed tile best predictor of the combined rankings. The corre- 
lation was only .3, however, and it was not statistically significant. Combin- 
ing the score on subtest 4 with the grand sum yielded a multiple correlation 
of .39, and including as a third variable the sum of subtests 1, 2, and 3, 
yielded a multiple correlation of .47. None of these correlations is statis- 
tically significant and they are only mentioned here to indicate the variables 
which were selected and their effects on the multiple co:rrelation. 

The results of the stepwise regression analysis were interpreted as 
indicating that sane correlation might exist between SCF performance and judged 
success .in the remedial training program, although a. larger number of subjects 
vjould be required to defnonstrate statistical significance. The particular 
variables selected by the stepwise analysis suggested that the test was rela- 
tively hcrx)geneous with respect to prediction of this criterion and that sub- 
tests 1, 2, and 3, in particiiLar, might be sufficiently honiDgeneous to be treat- 
ed as a single variable. 

Another criterion TAMch might be considered as representing success in 
the program is vAiether the student ccmpleted the program or dropped out. A 
stepwise regression analysis was also carried out using this variable as the 
criterion and using the same set of predictions as described above. The 
analysis indicated a significant miltiple correlation (p<. 05) of .53 vdth 
score on test 1 and score on test 5 as predictors. 

Interpretation of this result is difficult since drop-outs are presum- 
ably influenced by motivational, situational, and other noncognitive factors. 
It is, of course, quite possible that performance on the test reflects moti- 
vational characteristics also, as one \\^uld expect of almst any test. The 
predictors in this case were not those found irost useful for predicting the 
rankings, so that the characteristics being used for this prediction x^;ere 
evidently different. 
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In January^ 1972^ records Vz-ere obtained of the actual perfonrance 
of the pilot st\:idy group in thair first semester of regular classes. 
Because of the small nurriber of subjects in the pilot study ^ a corplete analy- 
sis of prediction withi respect to this criterion did not seem likely to be 
useful, especially since there appeajred to be soms curvilinearity in the re- 
latijon^iij)* Bostead, an assessn^t was made of the effect that xvuuld have 
been obtained if the SCF test had been used for selecting the students . On 
the basis of the sca.tter plot relating overall SCF performance to average 
rankings by the department chairman^ a cutting score between 150 and 160 on 
the SCF. test appeared suitable for producing a maximum discrimination be-- 
tween high and low^ ranlcings. i\ccordinglyr a cutting score of 156 was taken 
to see what effect would have been produced on first semester regular college 
performance if that cut'-of f score had been used in selecting the students 
for the DSP program. 

The results of this hypothetical selection were as follows: at the 
end of the first regiolar selester, 60% of the students had achieved a pass- 
ing grade point average . Of those v*io would have been admitted with a 
requiraonent of 156 on the SCF test, 90% achieved a passing grade point 
average. Because of the curvilinear relationship/ the results were less^ 
satisfactory with respect to those students who woiold not have been admitt- 
ed under the SCF test reguiremsnt. Of these, 40% achieved passing grade 
point averages. Only 38% of the students achieved the SCF test requirement, 
so that the test would have been useful only with a rather favorable selec- 
tion ratio, but the possible utility of the test for this purpose is worth 
noting. ^ 

In a separate study intended to obtain some indication of the extent 
to vMch the SCF test, is sensitive to cultural differences, the SCF test was 
administered to 64 business executives in the Fort Vforth area. The total 
scores for the executives ranged from 113 to 195. For the pilot study group, 
the total scores ranged from 115 to 184. A detailed coirparison of SCF per- 
formance frcm these two culturally very different groups is given in Table 
1; the corparison suggests that the cultural differences are not associated 
with substantial differences in SCF performance. 

The preliininary findings fron the pilot study suggested that further 
research on SCF performance as a predictor of college potential in disad- 
vantaged students was varranted. The results of the pilot study w^e pre- 
sented in a syitposium at the April, 1971 meeting of the Southwestern Psycho- 
logical Association, and are included in the proceedings of the syitposium 
(Evans and Ellis, 1972) . 
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TABLE 1 



Cot^sarison of SCF Test Results in McLeiman DSP Pilot 
GtoDup with those of 68 Business Executives 



McLennan Executive McLennan Executive 

SCF Score Mean Mean Std. Dev. Std. Dev. 



Test 1 29.6 30.2 3.8 4.3 

Test 2 27.5 28.4 6.1 4.1 

Test 3 27.8 25.9 6.8 9.5 

Part I 84.9 84.2 12.2 13.4 

Test 5 20.9 21.5 3.2 4.1 

Test 6 22.7 22.5 5.0 5.4 

Part II 66.9 67.3 6.6 8.1 

Total 153.1 155.1 14.4 18.4 
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Ill, >IZmJ STUDY 



A, WBtlTDd 

1. Subjects , Subjects for this study VTere the students (N=98) who ' 
enrolled in the Developirental Studies Prograin in September, 1971. In 
other respects, they v^^e similar to the subjects in the pilot study. 

The min study subjects incliided 50 Caucasians, 35 Blacks, 9 Chicanes, and 
4 American Indians. The Tvean ACT for the siibjects \>as 10.2, with ACT 
scores ranging fron 3 to 16. The nationaJ. irean for the ACT in 1971 was 20, 
with standard deviation of 5. 

Four of the subjects were dropped from the study because of early 
departure frcm the DSP. 

2 . The SCF Test . The test was the revised form developed in the 
analysis of the pilot study results . It consisted of six si±>tests of 35 
items each. An exanple of the test is included in the appendix. The test 
was administered in Septariber, 1971, shortly after the beginning of the 
semester. 

3. Measijres of Success . In surrmer, 1972, three measures of achieve- 
ment in the program were obtained.. Persons providing the information had 
no knowledge of the performance of students on the SCF test. The measures 
were as follows: 

a. Acadenac Record. This record was initicilly available in the 
standard A through F scale. Advice from the DSP staff / however, indicated 
that the principal discrimination being made was A-B, indicating definite 
success, versus C-D-F, indicatmg lack of success. Since the letter grade 
distinctions witliin these categories were thought not to represent reliable 
distinctions, academic performance was treated as a dichotoiTy, success 
versus non--success , indicated by the average grade. 

b. Fating of Learning Ability. The DSP staff rated each student 
according to judged learning ability. The ranking method used in the pilot 
study was not used in this case because the DSP staff did not feel they could 
give a meaningfiil raric ordering for 98 students. The rating was made on a 
three point scale, again in corrpliance with the advice of the DSP staff 

that finer discriminations ^\7ere not feasible. The three points were charac- 
terized as follows: poor - 0, average - 1, excellent - 2. ' Each rating was 
made by the chairman of the department in consultation with another teacher 
of the student. 

c. Fating of Inprovement. The students were rated as to the extent 
to viiich they had profited fron the program, regardless of estimated potential. 
The scale was the same as the scale for learning ability, and it v;as \ised for 
the same reasons. 
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B. Results 



Surancory SCP test results are ^iven in Table 2. A^ain, individual 
differences in perfoOTanca v;ere evident. Because of the inclusion of a 
''Cannot Say" category in the answer sheet of the revised form of the rest, 
these statistics are not directly coirparable with those of the pilot group 
and of the business executives described in the pilot study. 

Table 3 presents the single best prediction for the criteria of success 
in the DSP program. In accord with the indications of the pilot study, the 
ineasures obtained fron the SCF test do show significant correlations with 
each of the criteria. Moreover, the total score and the subtotal on tests 
1, 2, and 3 appear to contribute most to prediction of success. This 
finding also agrees with the resxalts of the pilot study. The correlations 
among the three criteria \^;ere as follows: between rated learning ability 
and rated inprovement, the correlation was r = .66 (p <.01) ; between 
academic performance and rated ability^ the correlation was r = .56 
(p <.01) ; between academic performance and rated irrprovemsnt, the correla- 
tron was .45 (p<.01). 

Since the criteria were evidently measuring sane of the sane charac- 
teristics, they could usefully be combined to form rrore general surmory 
criteria. Therefore, Table 3 also presents results with respect to a surimary 
criterion representing all three criteria. The summary criterion for each 
S was formed by taking the unweighted irean of his scores on the three sepa- 
rate criteria obtained frcm the DSP. 

Fran a practical standpoint, the irost appropriate criterion of success 
in the DSP is not any measure taken in the program itself, but sorre measvire 
of how well ,the student performed in subsequent experiences - especially 
in the inmediately subsequent semester. A cortplete assessrrent of DSP 
success by that criterion \>?ould, of course, require a control condition to 
show how much the students benefited from the DSP as ooirpared to how well 
an equivalent groiip did without the DSP. An ijavestigation of that magni- 
tude was beyond the scope of the present study, but it is of interest to 
ask how well the SCF test predicted subsequent academic perfonrance in the 
student's first regular semester. That information is given as the last 
entry in Table 3. The criterion was grade point average obtained in the 
fall, 1972, semester after completion of the DSP in the spring, 1972, 
semester. Four students did not oorplete the fall, 1972, semester and 
their data were emitted in conputing the correlation betiveen SCF variables 
and si±)sequent academic performance. 
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TABLE 2 
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Surrarary Statistics of McLennan DSP Groiro on the SCF Test 

Vlean Standaird Deviation Range of Scores 

Test 1 20.7 3.8 11-29 

Test 2 20.5 4.4 7-29 

Test 3 15.7 4.9 5-31 

Part 1 57.0 9.0 33-80 

Test 4 15.8 3.5 4-24 

Test 5 14.3 3.2 5-23 

Test 6 14.8 3.2 7-25 

Part II 45.0 6.9 23-62 

Total Score 101.9 12.87 77-133 
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TABLE 3 



Single Best Predictor for Several Criteria of .Smccess 
in DSP f ran SCF Scores 



Crit^^rion 



Predictor 



1, Acadonic Perfoxmance in DSP 



Total Scsore 



ia^nrelaticn 



(p <.01) 



2. Rated Learning Ability 



Subtotal 
1/ 2, 3 



^5 (p <.01) 



3. Rated iEtprovOT^ent 



4, Mean of all DSP Criteria 
(1, 2, and 3 above) 



Subtotal 
1, 2, 3 



Subtotal 
1, 2, 3 



.38 (£ <.0)1) 
A2 (p <,01) 



5. Subsequent Acadendc 
Performance 



Test 2 



.33 (£ <.01) 
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Table 4 presents the results of multiple regression analysis for pre- 
:liction of the various criteria of success. A stepwise regression analysis 
vas used as discussed in the pilot study. The saire predictors \vere used as 
in tha pilot study, Ihe results reported here are for the best three vari-- 
*at)le^. (Technical considerations in tests of signigicance argue against 
selecting the number of variables to be reported on the basis of the statls-- 
tical test.) In no case did variables beyond the best three produce inore than 
a trivial increase in the lailtiple correlation. In each case, the multiple 
correlations are statistically significant, but the inprovement over the single 
best predictor is not great. 

Thus, it appears that, as the pilot study suggested, the test is rela-* 
tively hcanogeneous with respect to prediction of these criteria. Apparently, 
iTost of the piredictive power of the test is captured in the unweighted sim of 
all subtests and in tlrie subtotal v*iicdi is the unweighted sum on tests 1, 2, 
and 3. Scane additional predictive power itay be offered by test 2, since it 
does occur frequently as an additional predictor. 

It may be noted that academic perfontonce was the variable best corre^ 
lated by 9CF. For coitparison, the T^rican College Test yielded a cxirrela- 
tion of .14 (not statistically significant) with academic performarce. Thus 
it appears that the SCF test offers substantially better predictive power in 
this context than does the standardized aptitude test. 

IV. DISCUSSION 

The results indicate that SCF test does have some potential utility 
as a iteasure of cognitive aptitudes in disadvantaged students, vdiere such 
aptitudes are defined as aptitudes bearing on siaccess in a remedial training 
program. The obtained correlations are not large, but the substantial agree- 
nmt between the resiolts of the pilot study and those of the main study suggests 
that the finding of this relationship is not merely statistically significant, 
but is replicable from year to year. Moreover, the present test is surely not 
yet optimal, and some iiTprov«tent in correlations should be attainable by 
fiirther refinements* 

For practical piarposes, a correlation does not have to be very high to be 
loseful/ especially when the selection ratio is favorable. Seashore (1953) has 
noted that relatively few validity coefficients especially in industry, are 
above .50. The validity coefficient represents a more precise prediction than 
is required for selection; itoreover, selection often takes advantage of the fact 
that prediction is usually better in discriminating the extremes than in accu- 
rate placement in the mid--range of a scale. Thus it is often better tp con-- 
sider, instead of the correlation, the direct effect of selection with a 
given validity on percentage of successful students. 
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TABLE 4 



Multiple Regressicxi Analysis for Prediction of Varioias 
Criteria of DSP Svjccess from SCF Scores 



Criteria 



Predictors 



Beta Vfeights 



Multiple 
Regression 



1. Acadanic 
Perfontance 
(in DSP) 



Total Score 
Test 6 
Test 2 



.219 
.217 

.169 



.49 
(p <.01) 



2. Learning 
Ability 



Subtotal 1/ 2, 3 
Test 2 
Test 5 



.279 
.179 
-.142 



.40 
(£ <.01) 



3. Irtpravement 



Subtotal 1, 2, 3 
Test 2 
Test 6 



.310 
.133 
-.041 



.40 
<.01) 



4. i.fean of all 
DSP Criteria 
(1, 2, and 3 above) 



Subtotal 1, 2, 3 
Test 2 
Test 6 



.296 
.183 
.056 



.45 
(E <.01) 



5. Subsequent AcademLc 
Performance 



Test 2 

Subtotal 1, 2, 3 
Test 6 



.220 
.225 
-.072 



.37 
(p <.01) 
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As ar: illu^xatian, consider the effect on the Developmental Studies 
Program, if this test were used in selection of students (assume that its 
predictive validity for academic perfornmce is essentially vtot was found 
in this st'ody/ that is, .5) : By the present selection methods , 60% of the 
students received satisfactory ratings — ^they were successful in the DSP 
program in terms of their academic performance and/or in terms of rated 
learning ability and degree with \*iich they were able to benefit f ran the 
program. VJhat percentage of irrprovement could be expected if the SCF task 
v^ere used as a selection device? For an answer consider Table 5. Valvies 
for this table were obtained from the Taylor-Russell tables. (Taylor & 
Russell, 1939). . 

At present, about 60% of students now accepted for training are successful, 
according to the criteria used in the present study. VJith a .50 selection 
ratio, (only 50% of the students are accepted) the SCF test would increase the 
proporticn of successful students to ,76. Even if 80% of the students are 
accepted (selection ratio .8) the increase to 67% could be useful if cost per 
student is high. 

Of course, it is not reccnimended that SCF test performance be used as the 
sole standard for admission to the DSP. Indeed, the DSP is not at present 
obliged to limit its enrollitent. But if the test were being considered for 
use, it WDuld be appropriate only as part of a battery of selection procedures. 
Before the SCF test could be considered for use elsev^iere, of ooxirrse, a good 
deal of additional validation data would need to be accumulated. 

More generably, much further research is indicated along theoretical^ 
lines, GoTogh's (1965) proposed three-stage test evalxaation would be desirable 
for SCF: the present type of study, having to do with validity, v^ould be the 
primary evaluation. Secondary evaluation v^ould elaborate on the rteaning of 
that vAiich is measured and tertiary evalixation would concern the inportance 
of the msasure beyond its primary area of relevance. For exairple: SCF has 
been identified, denionstrated, and correlated with certain other behaviors, 
yet the underlying basis for it is unknown. Is SCF dependent on innate 
neurological differences? Is it genetically influenced? Can its function- 
ing be localized in the brain? 

Fran a practical standpoint, other modes of SCF should be investigated, 
such as an auditory form of the Task for possible xase with music students or 
blixid people^ Is pattern perception via the various senses identifiable as 
the same process? What about three dirnsnsional patterns? What work-related 
behaviors are associated with SCF ability? These and many other questions 
raitain for the secondary and tertiary stages of research on SCF. 

This research is consistent witl:i Evariis (1967a) fontrolation of SCF as cited 
in the introduction of this paper. Humans can extract relevant features from 
the environment in order to classify objects and to identify future instances 
of the same pattern family. Measurejnent of this ability by use of a test such 
as the one developed for this project has utility in areas of application 
'vAiere usual selection devices are ineffective. 
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TABLE 5 



Hypothetical Exartple: Possible Effect of Using 
SCF Test to Select Students for DSP 



A. 

Selection 
Ratio 



B. 

Percentage of 
Successful Students 
Without Use of SCF 
Task 



C. 

Percentage of 
Successful Students 
With Use o| SCF 
Task 



D. 

Difference in 
Percentage 
Between 
Columns B & C 



.50 
.60 
.70 
.80 



.60 
.60 
.60 
.60 



.76 
.73 
.70 
.67 



16 
13 
10 
7 



*Assming r = .5 
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APPENDIX 
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GENERAL INSTRUCTIONS 



People often learn to recognize complex patterns v/ithout giving 
it much thought. Recognizing a person's handwriting pattern is an 
example. of this ability. It is fairly easy to recognize a person's 
handwriting pattern even though it is never exactly the sane from 
time to time. * 

To illustrate how people recognize complex patterns, you have a 
sheet of paper containing 5 pairs of handwritten words. Your job 
is to decide for each pair whether the handwritten samples represent 
the same pattern or two different patterns (i.e. they were written 
by the same person or by tvjo different people) . 

Row to respond. Choose among the statements below the one that 
best represents your opinion about each pair of patterns and enter 
the letter (a, b, c, d, or e) representing it on the answer sheet 
after the number corresponding to each pair of patterns : 

a. The patterns are very similar to each other and very probably 

belong to the same class. 

b. The patterns are fairly similar to each other and seem likely 

to belong to the same class. 

c. The patterns are not really very similar or dissimilar and it 

is hard to say whether they belong to the same class or not. 

d. The patterns are fairly dissimilar and it seems likely they don't 

belong to the same class. 

e. The patterns are very dissimilar and quite probably belong to 

different classes. 

Remember you must decide if the handwritten words represent 
the same pattern or two different patterns; then you must indicate 
how similar the two examples are. Take no more than 20 seconds for 
each pair. Do you have any questions? 

Answer Sheet for Handwritten Samples 

1. 



2. 



3. 



4. 



5. 
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KANDWRITING SAMPLES 




Task 1 



Instead of haruSwriting in this task, you vdjl be looking at unfamiliar 
graphs. None of than will tie exactly alike, but some of the pairs -will be 
exanples representing the same pattern, •'.■^ile others •will be exanples repre- 
senting tvjD differait patterns. 

In other "words, they -will be just like the handwriting sanples, and you 
are to deal with them in the same way, by altering the letter that cx>rrespancls 
to your juigment on appropriate space on your ansvrer sheet. Use the same 
response alternatives; 

a. The patterns are very similar and probably belong to the same class. 

b. The patterns are fairly similar and seem likely to belong to the same 
class. 

c. The patterns are not really very similar or dissimilar and it's hard to 
say vtether they belong to the same class or not. 

d. The patterns are fairly dissimilar and seem likely to belong to different 
classes. 

e. The patterns are very dissimilar and probably belong to different classes. 

You will be given plenty of time to finish, but you will do better if 
you work quickly and rely on ycnxc first inpressicn. Are there any questions? 
If not, Wciit for the signal to start the task. 

Answer Sheet for Task 1 

1. 16. 31. 



2. 17. emit 32. 

3. 18. 33. 



4. 
5. 
6. 
7. 
8. 
9. 



19. 34. 

20. 35. 

21. 36. 

22. 37. 

23. , 38. 



24. omit 39. 

25. emit 40. 

11. 26. 

12. omit 27. 



13. emit 28. 

14. 29. 



15 



30. 



Omit 




.1 Si 



Task 2 



In this task, you will again be looking at unfamiliar graphs, 
but there will only be one on a page. A number of the graphs v;ill 
represent the same pattern - as if we were using a number of examples 
of the same person's handwriting. The other graphs will each repre- 
sent a different pattern. Your task is to discover the examples of 
the recurring pattern. Naturally, you v;on't be able to tell" which 
pattern is recurring until you have seen a few examples, but soon 
you should begin to notice it. Keep in mind that two graphs can 
show the same pattern without being identical. 

In making your answer please choose one of the following responses, 
and enter its letter in the appropriate place on the answer sheet: 

a. I am very sure this graph is an example of the recurrent pattern. 

b. I am fairly sure this graph is^ an example of the recurrent pattern. 

c. It's hard to say if this graph i£ an example of the recurrent 

pattern or not. 

d. I am fairly sure this graph is^ not an example of the recurrent 

pattern. 

e. I am very sure this graph is^ not an example of the recurrent 

pattern . 

One last thing - your third task will require that you remember 
the recurrent pattern you saw in this task, so try to learn what it 
looks like. Are there any questions? If not, wait for the signal 
to start. 



1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 
10. 
11. 
12. 
13. 
14. 
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omit 
omit 



Answer Sheet for Task 2 

16. 

17. 

18. 

19. 

20 . 

21. 

22. 

23. 



24. omit 

25. 

26 . 

27. 

28. 

29 . 

30. 



31. 
32 . 
33. 
34. 
35. 
36. 
37. 
38. 
39. 
40. 



omit 



omit 



s 




Omit 




t 

^0 
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Task 3 



In this task, you will again look at graphs one at a time. 
Some of the graphs will represent new examples the same pattern 
you saw in* the previous task. Others v;ill zeprB'^-^nt exaitiples of 
a nev7 pattern, v;hich n^ay also recur. Thii^ Ic^^X will 'be Tniach like 
the previous task in that you are again suppo^,iOd to ic.:..tiifv the 
recurring pattern you learned in the previous re^.^:^K^v To make your 
answer, choose one of the following responses an:' ';:^:iter its letter 
on the appropriate place on the answer sheet; 

a. I am very sure thr.s graph is_ an example of tU-i r^^current pattern 

from the previous task. 

b. I am fairly sure this graph is^ an example of the recurrent pattern 

from the previous task. 

c. It is hard to say if this graph is an example of the recurrent 

pattern from the previous task or not. 

d. I am fairly sure this graph is^ not an example; of the recurrent 

pattern from the previous task. 

e. I am very sure this graph is_ not an example of the recurrent 

pattern from the previous task. 

Are there any questions? If not, wait for the signal to start. 

Answer Sheet for Task 3 



1- 16. 31. 

2- 17. 32. 

3. 18. 33. 

4- 19. 34. 

5. 20. 35. 

6. 21. 36. 

7^ 22. 37. omit 

8. omit 23. 38. 

9- omit 24. 39. 

10. 25. 40. 

11- 26. omit 

12. 27. 

13. 28. 

14. 29. omit 

15. 30. 
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Task 4 



This task is exactly like the first task, except that you will 
be looking at things which seem like phrases in unfamiliar languages. 
Let's assume that they are languages^ just to make the instructions 
simpler. In this taskr you will find that each page of the booklet 
contains two phrases, one below the other. Sometimes the two phrases 
come from the same language; other uimes, the two phrases come from 
different languages. Both languages use the same syllables, but 
they have different patterns for the arrangement of the syllables • 
Your task is to judge whether they are from the same language or 
from a different language, and indicate your choice by entering 
its letter in the appropriate space on the answer sheet: 

a. The phrases are very similar and very probably belong to' the 

same language. 

b. The phrases are fairly similar and seem likely to belong to the 

same language. 

c. The phrases are not really very similar or very dissimilar and 

it is hard to say whether they belong to the same language or not. 

d. The phrases are fairly diS5?imilar and it seems likely they don't 

belong to the same language. 

e. The phrases are very dissimilar and quite probably belong to 

different languages. 

Are there any questions? If not, wait for the signal to start. 

Answer Sheet for Task 4 



1- , 16. 31. omit 

2. 17. 32- 

3. 18. 33. 

4. 19. __ 34. 

5. 20. 35. 

6. 21. 36. 

7. 22. 37. 

8. 23. 38. 

9. 24. omit 39. 

10. 25. 40. 

11^ 26. omit 

12. omit 27. 

13. ^ 28. 

14. 29. omit 



30. 



GADUNUSU GEKO VISUGE KOVI 

NU GAVI GEDUSUKO GEDUSUKO 



GEDU NUGAVI GEDUSUKO NU NU 

DO VI NOG AVI GE DUNUGAVIGE 



Omit 

KONUGAVI DU SUKO NUGA VI GE 

KOVI GADUNUSUVI GADU NUGA' 



VIGADUNU SUGE KOGADU KOVI 



GADUGEKO VIGAGADU NU GEKO 



SUKO. NUGA VIGEDU SUKONUGA 



SUKONUGA VIGEDU SUSUICO NU 



SUKONU SUKONU DUGEGE DU KO 



GEKOVIGADU SUGE KOVI GADU 



NUGADUSUKO NUNUGA VIDUSU 



KONUGAVIGE DU SUInIUGASUKO 



KONU NU GAVIGE DUSU KONUGA 



DUSU KONUGA VIGE KOVIGE KO 



Omit 



DUSUKONU GAGE DUSUKO NUGA 



NUSU GEKO GEKO SUGEKO VI GA 



GAVIKONU GAVIGEDU SUKODU 

DUNU VIGADU NUSUGE KOVI 



KOVIGADUNU SUGEKOKO VIGA 



DUSUKO NUGA SUKONU GA VI 



SUKO NUGA VINU GAVIGE DUVI 



SUKO NUGANU GAVIGEDU SUKO 



SUDU SUKO NUVIGEDU SUKO NU 



KOGE KOVIGANU SUGEKO VIGA 



SUKO NUGANUSU KONUGAVI GE 



VIGAGADU NUSUGE KOVIGADU 



KOVIGA DUNUGADU NUSUGE NU 



KOVIGA DUGADU NUSU GEKO VI 



DUSUKO NUVIGE DUSUKONUGA 



GEKOVIGANU SUGE KO VIGADU 



GIKO VIGADU NUSUVI NUSUVI 



KONUGAVI NU GAVIVI GE DUSU 



KONU GAVIGE DUGEDU SUKO'NU 



VIGADU MUSU GESUGEKO ■ VI GA 



NUSUGE KOVI GADUNU SUGEKO 



VI GEDUSUKO NUGA VIGEDUSU 



GEKOVIGA DUKOVIGA DUNUSU 



KO VI GADUGAKO VIGADU NUSU 



DUSUICO NUGA VI GE DUSU KONU 



DUSUKONU GAVI GEDUSUDU SU 



GEKONU SUGEKO VI GA DUNU SU 



DUNUSUGEKO VIGAVI GADU 



VrGA DUNUGADU NU NUSU GEKO 



NUGA VIGEDUDU SUKONUGA 



DUSUKO NUGA VIGEDU SUKONU 



GEKOVIGA DWIUSU GEKO VI 



GEKOVIGA DUMU SUGEKO VIGA 



KOVIDm.'U SUGEDOVTGA DUGA 



SUKONU GAVI GEDUSU KO NUGA 



NUGAVIGEDU SUKO NUGAVIGE 



GE DUSUKO NUGAVI GEDUSU KO 



DU SUGAVINU GEDUSUKO NUVI 



VI CEKONU SUGENUSUGE KOSU 



SUGEGA DUNUSUGE KOVI GAGA 



Omit 

GADUl>rU SUGEGE KOVI GADUGE 



KOVI GADU NU SUGEKOVIGA DU 



GEKOVIGA DU NUSU GE KO GEKO 

GEKOVIGA DUNUSUGEKO VIGA 



DUSU VI GE DU SUKOIJUGAVI GE 



GAVIGEDU SUKONUKO NUGAVI 



VIGEDUSU KONUGA VIGEVIGE 



GADUNU SUGEKO VI GA DUNUSU 



SU GEKOVIGA DUNUSUGE KOVI 

X)USUGAVI SUKONU GAVIGEDU 



Omit 

VINUGADU NUSUGEGADU NU SU 

DUSUICO NUGAVIGEDU SIKO NU 

Omit 

NUSUGEKOVI GA DUNUSUNU SU 

\riGE DUSU DUSUGEDUSU KONU 



GAVI GEDU SUKOSUKONU GAVI 



NUGAVIGEDU GAVI GEDUSU GA 



KOVIGA DUIJU SUGEKOVIGA DU 



SUKOGA VIGS DUSU KONU GAI-IU 



GAGA VIGEDU SUKONU GAVIGE^.^v' 

DUDU NUSU GEKOVI GADUNUSU 



KODUSUVIGE iiUVIGEDU SUGS 



SUKONU GAVIGEKO irOGAVINU 



VIGADUNU GE ■ KOVI GA DUNUSU 



KOVX GAKOVI GAGE SUSU GEVI 



Task 5 



This task is just like the second task except that you will be 
looking at more phrases from an unfamiliar language. A number of 
the examples will be d^-av;n froin one language; you V7ill recognize 
the^ because they show the same pattern. Other phrases are'^from 
many different languages, and so they do not show a common pattern^ 

In making your ans^/;er please choose one of the £ollov;irig responses, 
and enter its letter in the appropriate space on the ansv7er sheet: 

a. I am very sure this phrase is^ an example of the recurrent language. 

b. I am fairly sure this phrase is an example of the recurrent language. 

c. It is hard to say if this phrase i_s^ an example of the recurrent 

1 anguage . 

d. I am. fairly sure this phrase i£ not an example of the recurrent 

language . 

e. I am very sUre this phrase is not an example of the recurrent 

language. 

Again, in this task, you should remember the recurring pattern 
because you will need to recognize it ^n the next task. Are there 
any questions? If not, v/ait for the signal to start. 

Answer Sheet for Task 5 



1- 16. 31. 

2. 12. 32. 

3. 18. omit 33. 

4. 19. 34. 

5. 20. omit 35. 

6. 21. 36. 

7. 22. 37. 

8. 23. 38. 

9. omit 24. 39^ 

10. 25. 40. 

11. 26. 



12. 27. 

13. 28. 

14. omit 29. 

15. 30* omit 



EKLC 



GITJl DuGAITUBU SO GA I-IU3U5n 



DUGASU VISUVI G/vDUGE SUSU 15 



SUGE GEVIDU GANUBUSUGE VI 



29 



SUGE VIDUGAJIU BUGEYI BU SU 2 

GEBU NUNU BUVlVIStJNU DUGE 16 

Omit 

BUSUGEVI DUGA NU BUBUSU GE 30 



NUv^ABUGASU SU3USU VIBUGE 



BUSUVIDUGA Is^UBUSO GEVIGE 



SUGANU DUGESUGEGE GAGEDtJ 



VIDUSUGZ VIDU GA IIU BUSUXU 



Omit 



GAVINUNU GAVINUNUBU GENU 



I 



BOVINUGA DUNUGA DUNUGA BU 



DU VirCU GA BUGZSU DUG.\BU3U 



GAVIBUNU GE GEVI DU VIVTtJU 



VIGEGESU NUVI NUDUDUGE GE 



/ 



BUNU BUSUG" DUaJi!iU3U SUGE 



Omit 



SUMUBUDU GANUDU GANUBUGA 



NUSiJ SUGE VIDUGASU DU GASU 



NUBU SUGEDU GANU3U SUGEVI 



BUSUGE VIDUGA SUGEVI DUGE 



GAGABU SUGA BUBUNU SUGANU 



VIDU BUGAGADU DUBUNUGA DU 



NUGADU GESUBU GEGADU3UGE 



GEDUNU VIVISUVIVI SUGA GE 



Omit 

VISU NUBU GE. GAVIKUBUGA NU 9 

GANU GEVI DUGANUBU SUGEGE 23 

NUBU SUGE VIBUSU GEVI DUGA 37 



ERIC 



DUGA NU BUSUGEVIDU GAMUBU 



SUDU GEVIDU GANUGE VIDUGA 



GEVI NUBUSU GEGEVI DU NUBU 



GEBU NUDU VIGA SUBU GESUDU 11 
SUGESUGABU NUNU GAVI BUVI 25 
SUGADU SUSUVIDU BUGEBU NU 39 



ERIC 



NU3U DUGA NUBUSUGE VIDUGA 12 
SUGEGASUGE DUGA SUBUDU BO 26 
NUGE NU GESUDUBUNU SUVIGA 40 



ERIC 



VIDUGA NU BUSUGESUGE VIDU 13 



SUGA VIBUBU DUGEKUGE NUSU 27 



ERIC 



0 M I . T 



NOBUSU GEVIDUGA NUBUSU GE lA 



BUSU GEVI DUGA NUBUSUGEVI 28 



ERIC 



Task 6 



Tl\is task is just like the thirci -cask, except that the patterns 
are like phrases in unknown languages. There will be nev; examples 
of the recurrent language you saxv in Task 5. Other phrases will re- 
present examples of a new language and there will be a number of 
examples from this language also. This task will be much like the 
previous tar»k in that you are again supposed to identify the examples 
of the recurring languages you learned in the previous task. To make 
your answer, choose one of the following responses and enter its 
letter in the appropriate place on the answer sheet: 

a. 1 arc very sure this phrase i_s an example of the recurrent language. 

b. I am fairly sure this phrase is_ an example of the recurrent language. 

c. It is hard' to say if this phrase is^ an example of the recurrent 

language from the previous task or not. 

d. I am fairly sure this phrase is_ not an example of the recurrent 

language from the previous task. 

e. I am very sure this phrase _is not an example of the recurrent 

language from the previous task. 

Are there any questions? If not, wait for the signal to start. 

Answer Sheet for Task 6 



1. 
2. 
3. 
4. 
5. 
6. 
7. 
8. 



omit 



omit 



16. 
17. 
1«. 
19. 
20. 
21. 
22. 
23. 



omit 



31, 
32, 
33, 
34, 
35, 
36, 
37, 
38 



9. 

10. 
11. 
12. 
13. 



24. 
25. 
26. 
27. 
28. 



39. 



40. omit 



14. 
15. 



29. 



30. omit 



Omit 

BUSU GEVI GEBU SUGEVI DUGA 1 

GABU DUVIDU VIBUDU VINU SU 15 

SUGEVI DUGANUGANU BUSUGE 29 



ERIC 



so GEVI DU GEVIDU DUGAI^UBU 



SUGEVIDUNU BU£U GEVI DU CA 



Omit 



DUVI NU'SUGEGA BUDU VIDUVI 



GEVI DUGANDNU BUSU GEVI 



GEGEGABU DUVINUSUGE GABU 



NUBUSUGE VIDUGA NUBU SUGE 



VINUSUGESU VINUSU GEGABU 



NUSU GEGA DUVI NUSUGEGA 



DUVINUSU GEGA BUDU VINU 



NUSU GEGA SUGEGAGA BUDUVI 



VI NUSUVI NU SUDUBUBU DUNU 



NUBUSU GEVIDUGA NUBU NUBU 



Omit 

BUSUGEVI DU GANU • DUSU GEVI 

Omit 

BUSUGE BUSUGE NUGAGANUSU 



GANU BUSUGEVI DU GA NUBU SU 



SU GEGABUDU DUVIKUSU GEDU 



DUVI NUSUGEBU DUVINUSU GE 



NUBUSU GEVIDUGANU BUSUGE 



1 



ERIC 



.VINU SUGE GABUDU VINU SUGE 



VINUSUGEGA SUGE GABUDU GA 22 



BUDUVI NUSUGEGABU DUVI NU 36 



GEVI DUGA NUBU SUGE VIDUGA 



NUBUSUGE VIGANU BUSUGEVI 



NUBU VIDUGE GANU BUSUGE DU 



DUGAHUBU SUGEVI DUGADUGA 10 
VINUSU GESUGEGA BUDUVI NU 24 

NUBU VI DUBUSUGEVI DUGANU 38 



DUGANU BUNUBU GANUBU SUGE 



BUSUGE VIDUGE VIDU GSSEET DU 



DUVIGEGA SUBUDUVI NUSMHi 



SUGE GABU DU VINUSU GEGABU 



BUSUGEVIGE VIDUGA NUBUSU 



■ 0 M I t 
DUVIGE GAVINU SUGEGABUDU 



GADUDU VINUSU GEGABU GABU 



NUSU GEGABU DUBUDU VINUSU 



VIVl DUGANUBUSU GE VIDUGA 



DUVINU SUGEGA BU DUVI NUSU 



